PACE:
Precision Analytics for Coaching Effectiveness
A Journey Toward Precision Education in Anesthesiology
Matthew Caldwell, MD on behalf of PACE Collaborative
October 16, 2026
MPOG Annual Retreat
Disclosures
• PACE: AMA ChangeMedEd Precision Education Grant
• INSPECT: FAER-Research in Education Grant
Disclaimer: The opinions expressed in this presentation are those
of the author and do not necessarily reflect American Medical
Association policy
Marie-Francois Firmin-Girard
Challenges with current models of GME
Challenges with current models of GME
Diego Rivera
Detroit Institute of Arts
Sawatsky et al. From Apprenticeship to Assembly Line. J Grad Med Educ.
2023 Dec;15(6):627-631.
Incomplete picture of resident progression
“We define PE as a system that uses data and technology to transform
lifelong learning by improving personalization, efficiency, and agency at
the individual, program, organization, or health system levels.”
Desai SV, et al., Precision Education: The Future of Lifelong Learning in Medicine. Acad Med. 2024 Apr 1;99(4S Suppl 1):S14-S20
From Assembly Line Learning to Personalized Learning
AMA: Transforming Lifelong Learning Through
Precision Education Grant Program
• 11 teams granted $1.1M over 4
years
• 197 letters of intent
• 30 full proposals
Desai et al., 2024 Apr 1;99(4S Suppl 1):S14-S20. Epub 2024 Jan 29.
38 Million Cases
689 Million Medication Records
85 Billion Physiologic Observations
36 Residency Programs
1/3 of Anesthesiology Residents
Phase 1 Dashboard Elements
• Growth Trajectory
• Anesthesia case types
• GA, MAC, Labor epidural
• Anesthesia case management
• Neuraxial, PNB, Arterial line, FOI, OLV
• Patient characteristics
• Age class, ASA status
• High Education Low Occurrence
• Hemorrhage
• Hypoxia
• Hypotension
• High risk BMI
• Quality metrics
• PONV
• Monitoring gaps
• NMB best practices
• Low BP avoidance
• Supervision
• Targeted longitudinal feedback
• Reflection and learning plans
Date
HELO Event
Procedure Text
Faculty
10.05.2026 Severe Hemorrhage Liver transplant Dr. Red
08.22.2026 Hypoxia Bronchoscopy, stent placement Dr. Blue
05.13.2026 Severe Hypotension Radical neck dissection Dr. Purple
03.04.2026 High Risk: Low BMI G-tube placement Dr. Green
HELO Events
Anesthetic Record
INSPECT
Improvement in the Scope and Precision of Educational Cases for Trainees
FAER-REG 08-15-2023
*Preliminary data: not yet published
What's the timeline (2026 – 2029)
Success metrics
- Dashboard engagement
- Coaching conversations
- MAL attitudes and behaviors
- Program improvement
PACE Timeline
• Academic year 2027-2028 for 10 coaching sites
• Academic year 2027-2028 for 3 non-coaching sites
• Rolling onboarding process for additional MPOG sites following successful launch
Dissemination
• Open-source data definitions
• Resident clinical experience metrics
• Data-enhanced coaching toolkit
• Implementation insights
– Dashboard and coaching
– Successful case methodology
• AMA Consortium: Precision Education Challenges and Mitigation Strategies
Principle Investigator: Matthew Caldwell, MD*
Co-Investigators:
• Sachin Kheterpal, MD, MBA*
Department Chair & MPOG Executive Director
• Amy Miller Juve, EdD, MEd**
(Oregon Health & Science University)
Coaching Program Lead
• Norah Naughton, MD, MBA*
Senior Associate Chair for Education
• Nirav Shah, MD*
Data Integration & Dashboard Development
• Lara Zisblatt, EdD, MA, PMME*
Evaluation Lead
Coordinating Center: University of Michigan*
Collaborating Sites:
• Henry Ford Heath
• Johns Hopkins University
• Oregon Health & Science University
• University of California San Francisco
• University of Michigan
• University of North Carolina
• University of Oklahoma
• University of Virginia
• Washington University
• Yale University
